2008-09-15 01:17 hey 2008-09-15 01:22 hi 2008-09-15 01:22 new lkml post just when out 2008-09-15 01:23 "Tux3 Report: What next?" 2008-09-15 01:28 http://lkml.org/lkml/2008/9/15/23 2008-09-15 01:52 -!- konrad(~konrad@c-24-16-74-109.hsd1.wa.comcast.net) has joined #tux3 2008-09-15 02:10 just read the post 2008-09-15 02:10 good advertizement :) 2008-09-15 02:11 that's the idea 2008-09-15 02:12 ok night :) 2008-09-15 02:45 http://www.letterp.com/~dbg/practical-file-system-design.pdf <- a book on filesystem design 2008-09-15 02:45 I should read it 2008-09-15 02:45 learn something 2008-09-15 03:06 -!- hirofumi(~hirofumi@210.171.168.39) has joined #tux3 2008-09-15 03:56 flips: git has another level between the repository and your checkout. that's why you need to do the commit -a 2008-09-15 03:56 you can just alias it though 2008-09-15 04:47 -!- data(~data@echo489.server4you.de) has joined #tux3 2008-09-15 07:02 -!- eli(~elicriffi@66.249.86.209) has joined #tux3 2008-09-15 07:48 -!- Kirantpatil(~kiran@122.167.194.220) has joined #tux3 2008-09-15 07:48 -!- Kirantpatil(~kiran@122.167.194.220) has left #tux3 2008-09-15 08:08 -!- amey(~amey@116.73.35.180) has joined #tux3 2008-09-15 08:08 100 2008-09-15 08:08 100! 2008-09-15 08:09 -!- amey(~amey@116.73.35.180) has left #tux3 2008-09-15 09:21 -!- RazvanM(~RazvanM@dazzler.isi.jhu.edu) has joined #tux3 2008-09-15 09:46 -!- Kirantpatil(~kiran@122.167.211.98) has joined #tux3 2008-09-15 09:46 -!- Kirantpatil(~kiran@122.167.211.98) has left #tux3 2008-09-15 10:13 -!- Kirantpatil(~kiran@122.167.211.98) has joined #tux3 2008-09-15 10:13 -!- Kirantpatil(~kiran@122.167.211.98) has left #tux3 2008-09-15 11:48 data, the thing is, it is not clear that git needs that extra level 2008-09-15 11:49 in fact, hg makes it clear that it doesn't 2008-09-15 12:23 -!- MaZe(~MaZe@216-239-45-4.google.com) has joined #tux3 2008-09-15 12:23 folks 2008-09-15 12:37 -!- pgquiles_(~pgquiles@62.43.226.52.static.user.ono.com) has joined #tux3 2008-09-15 12:40 hi bh 2008-09-15 12:40 hey maze 2008-09-15 12:40 see, today there is a tux3 filesystem in kernel 2008-09-15 12:40 that's the good news, the bad news is it's really just ramfs 2008-09-15 12:54 url to the post ? 2008-09-15 12:55 http://lkml.org/lkml/2008/9/15/23 2008-09-15 12:55 flips: tux3.org seems... slooow 2008-09-15 12:56 shapor, true 2008-09-15 12:56 don't know why 2008-09-15 12:56 getting lots of traffic? 2008-09-15 12:56 let's see what traffic I've got 2008-09-15 12:56 probably not 2008-09-15 12:56 haven't been monitoring 2008-09-15 12:56 could just be crappy linux vm stepping on itself 2008-09-15 12:56 means: close firefox 2008-09-15 12:57 perhaps git tree getting crawled 2008-09-15 12:57 googlebot is hammering me 2008-09-15 12:57 really hammering 2008-09-15 12:58 fsck 2008-09-15 12:58 DoS 2008-09-15 12:58 oh god 2008-09-15 12:58 it's indexing my git tree 2008-09-15 12:58 stupid, stupid bot 2008-09-15 12:58 /kickban googlebot 2008-09-15 12:58 thats easy 2008-09-15 12:58 robots.txt 2008-09-15 12:59 suggestions? 2008-09-15 12:59 where do I put it? 2008-09-15 12:59 http://en.wikipedia.org/wiki/Robots.txt 2008-09-15 12:59 put it in / 2008-09-15 12:59 User-agent: * 2008-09-15 12:59 Crawl-delay: 10 2008-09-15 12:59 damn I thought I could use the shapedia 2008-09-15 13:00 that will make it wait 10 seconds between requests to your box 2008-09-15 13:00 oh good I can 2008-09-15 13:00 I only want it to stay out of the git tree 2008-09-15 13:00 anything else it's welcome to index 2008-09-15 13:00 you can put in a disallow line then 2008-09-15 13:00 why not let it crawl the git tree with a 10 sec delay ? 2008-09-15 13:00 you can disallow like 2008-09-15 13:01 Disallow: /ddtree/ 2008-09-15 13:01 just think how many millions of dollars worth of storage git + lxr consume in goog datacenters 2008-09-15 13:01 so 2008-09-15 13:01 User-agent: * 2008-09-15 13:01 Disallow: /ddtree/ 2008-09-15 13:01 add some intelligence to googlebot, then donate 1/2 the savings to oss projects 2008-09-15 13:01 hrm although 2008-09-15 13:02 maybe you dont want the trailing slash 2008-09-15 13:02 in fact i dont think you do 2008-09-15 13:02 ACTION puts that in the suggestion box 2008-09-15 13:09 you should just disallow areas not meant to be indexed ;-) 2008-09-15 13:10 crawl-delay has a tendency to me of little actual use 2008-09-15 13:10 s/me/be/ 2008-09-15 13:10 MaZe: it should at least spread out the pain ;) 2008-09-15 13:15 mayhaps 2008-09-15 15:19 daniel@moonbase:/src/2.6.26.5.tux3$ git add robots.txt 2008-09-15 15:19 daniel@moonbase:/src/2.6.26.5.tux3$ git add fs/robots.txt 2008-09-15 15:19 daniel@moonbase:/src/2.6.26.5.tux3$ git diff 2008-09-15 15:19 daniel@moonbase:/src/2.6.26.5.tux3$ git diff -a 2008-09-15 15:19 no output 2008-09-15 15:19 fscking git 2008-09-15 15:19 I know there is a way, but how about it should just work 2008-09-15 15:19 good example of why we should mainly work with mercurial 2008-09-15 15:23 git diff HEAD 2008-09-15 15:24 true 2008-09-15 15:24 or git diff WANK 2008-09-15 15:24 ;-) 2008-09-15 15:24 thanks 2008-09-15 15:24 I like git ;-) 2008-09-15 15:24 I do too 2008-09-15 15:24 but not nearly as much as mercurial 2008-09-15 15:25 I'm using git for tinyos... what would be the reasons to switch to mercurial? :D 2008-09-15 15:29 RazvanM, mercurial makes it much easier for new contributers to get up to speed 2008-09-15 15:29 and doesn't get in the way of git experts 2008-09-15 15:30 basically, you just don't type the options that always seemed a little odd 2008-09-15 15:30 my ramp up for mercurial after git was about, um, 10 minutes 2008-09-15 15:30 same for Shapor I think 2008-09-15 15:30 Git took "some getting used to" 2008-09-15 15:30 hit more bugs in git than mercurial too 2008-09-15 15:30 and some things that should be bugs 2008-09-15 15:31 but are instead treated as features 2008-09-15 15:32 :D 2008-09-15 15:32 I definitely agree that it took me some time to get used to git 2008-09-15 15:33 for the dealing with changes for tinyos was very good for me though 2008-09-15 15:33 anyway as you can see I'm being even handed and using both 2008-09-15 15:33 puts me in a better position to complain about git ;) 2008-09-15 15:33 that is true ;-) 2008-09-15 15:33 tried mercurial? 2008-09-15 15:33 well you must 2008-09-15 15:33 if you have tux3 checked out 2008-09-15 15:34 for tux3 I had a chance to play with it 2008-09-15 15:34 it's just amazing how it seems to do the right thing by default 2008-09-15 15:34 the only whine I've had about it is, there isn't a simple command to delete a head 2008-09-15 15:34 there are a couple of longish commands available 2008-09-15 15:35 I did some changes to make it run on mac but then the new updates failed so I removed the files :P 2008-09-15 15:35 sorry 2008-09-15 15:35 I'll try to make fewer changes ;) 2008-09-15 15:35 hehe 2008-09-15 15:35 not your fault 2008-09-15 15:35 see if you can come up with some guidlines to make that smoother 2008-09-15 15:35 stuff I can do to make life easier for you 2008-09-15 15:37 I hope I'll find some time to try to make it work on mac 2008-09-15 15:37 these days you could probably make it work on a cell phone 2008-09-15 15:37 certainly a Nokia 800 series 2008-09-15 15:37 one thing that I did was to change mode_t to tux3_mode_t to avoid the collisions with the system's one 2008-09-15 15:37 :D :D :D 2008-09-15 15:38 want to send a patch or should I just do that? 2008-09-15 15:38 I'll do that 2008-09-15 15:38 what does it collide with? 2008-09-15 15:38 some libc thing? 2008-09-15 15:38 I think so 2008-09-15 15:38 could you find out? 2008-09-15 15:38 I need to reboot to see if my kernel panic is still in 10.5.5 2008-09-15 15:38 I'll be back 2008-09-15 15:39 (with the answer about mode_t :D) 2008-09-15 15:39 tux3 doesn't have a mode_t 2008-09-15 15:40 it uses the libc mode_t 2008-09-15 15:40 man 2 stat 2008-09-15 15:41 oops he's gone 2008-09-15 15:41 understandably 2008-09-15 15:47 i don't like the fact hg is python 2008-09-15 15:48 I don't care much 2008-09-15 15:48 I don't like the fact that guido doesn't support native code gen for python 2008-09-15 15:48 iow, guido is more of a problem than matt 2008-09-15 16:04 -!- RazvanM(~RazvanM@dazzler.isi.jhu.edu) has joined #tux3 2008-09-15 16:05 wb 2008-09-15 16:05 damn... they didn't fix my kernel panic :( 2008-09-15 16:05 my robots.txt fu is insufficient 2008-09-15 16:05 help me ;) 2008-09-15 16:05 who didn't? 2008-09-15 16:05 apple :P 2008-09-15 16:06 they just released 10.5.5 2008-09-15 16:06 how yahoobot it beating me up 2008-09-15 16:06 now 2008-09-15 16:06 ah 2008-09-15 16:06 linux seldom panics 2008-09-15 16:06 maybe apple will see the light 2008-09-15 16:06 about the mote_t: ./stdlib.h:typedef __darwin_mode_t mode_t; 2008-09-15 16:07 in my case it panics with a one line C program :P 2008-09-15 16:07 so... 2008-09-15 16:07 in exaclty what way is it incompatible? 2008-09-15 16:08 tux3 was also typedef-ing mode_t I think... 2008-09-15 16:08 perhaps it doesn't anymore :D 2008-09-15 16:10 it does not from what I see... 2008-09-15 16:12 I need to go back on some graphs for a paper. I'll try to make an attempt to get tux3 to compile on mac later tonight. 2008-09-15 16:17 cu 2008-09-15 16:17 tux3 u tomorrow ;) 2008-09-15 16:18 -!- shapor(~shapor@yzf.shapor.com) has joined #tux3 2008-09-15 16:19 typedef __uint16_t __darwin_mode_t; 2008-09-15 16:19 lamerz 2008-09-15 16:22 robots.txt standard is really lame 2008-09-15 16:22 only works in the root of the server 2008-09-15 16:22 "standard" :p 2008-09-15 16:23 yep 2008-09-15 16:23 tux3 uses mode_t in just one place: fuse 2008-09-15 16:23 does fuse work on mac? 2008-09-15 16:23 so send your complaint to our fuser department ;) 2008-09-15 16:23 I wonder 2008-09-15 16:24 would be weird hmm? 2008-09-15 16:24 mhm 2008-09-15 16:24 but fuse won't compile by default 2008-09-15 16:24 the pkg-config will just not fire 2008-09-15 16:24 I think 2008-09-15 16:24 ifeq ($(shell pkg-config fuse && echo found), found) 2008-09-15 16:24 binaries += tux3fs tux3fuse 2008-09-15 16:24 endif 2008-09-15 16:24 right 2008-09-15 16:24 so if there's a mode_t problem, it's not in the tux3 source 2008-09-15 16:25 nice piece of make scripting by the way 2008-09-15 16:25 who did that again? 2008-09-15 16:25 RazvanM maybe 2008-09-15 16:37 moonbase:/var/www# cat robots.txt 2008-09-15 16:37 User-agent: * 2008-09-15 16:37 Disallow: / 2008-09-15 16:38 I'll refine that later 2008-09-15 16:38 needless to say, googlebot is still bothering me 2008-09-15 16:38 flips: you know robots.txt does not work for rogue bots, do you? 2008-09-15 16:39 "don't take no for an answer" -- googlebot 2008-09-15 16:39 pgquiles, if I see a rogue bot I know what to do 2008-09-15 16:39 I can say that googlebot is very impolite 2008-09-15 16:39 :-) 2008-09-15 16:39 has no concept of staying within a reasonable share of bandwidth 2008-09-15 16:40 obviously, googlebot is coded and maintained by "smart people" ;) 2008-09-15 16:40 :-D 2008-09-15 16:48 oh, msnbot has joined the party 2008-09-15 16:48 everybody knows where there's a good party it seems 2008-09-15 16:49 now, I want to explain to them: crawl my site, just don't index every version of linus's git tree 2008-09-15 16:49 please 2008-09-15 16:57 tell someone at google about git 2008-09-15 17:01 flips: with a robots.txt like that it is likely you won't show up in search results 2008-09-15 17:02 I know 2008-09-15 17:02 I needed some peace 2008-09-15 17:02 while I write the real file 2008-09-15 17:02 Disallow: /ddtree didn't work ? 2008-09-15 17:02 i guess you dont really care about phunq.net anyway 2008-09-15 17:02 let's try it 2008-09-15 17:03 from my access logs it looks like most bots only grab robots.txt before a scan 2008-09-15 17:03 not before earch request 2008-09-15 17:03 so if they have already started crawling it might just keep continuing 2008-09-15 17:03 i dunno 2008-09-15 17:04 I know 2008-09-15 17:04 that's impolite 2008-09-15 17:04 also for your disallow i think you need to give full paths 2008-09-15 17:04 so 2008-09-15 17:04 Disallow: fifo.c 2008-09-15 17:04 specially for one like googlebot with zigabucks spent on it 2008-09-15 17:04 won't do anything 2008-09-15 17:04 true 2008-09-15 17:04 and it has to be in the root 2008-09-15 17:04 all of which is work 2008-09-15 17:04 if you run apache you could add a disallow for googlebot in the .htaccess 2008-09-15 17:04 which isn't pleasant when my system is getting hammered 2008-09-15 17:04 based on user agent 2008-09-15 17:05 does it work for nonhtml files? 2008-09-15 17:05 I guess 2008-09-15 17:05 yes 2008-09-15 17:05 but you have to name the bot 2008-09-15 17:05 right? 2008-09-15 17:05 yeah 2008-09-15 17:05 funny how these standards don't get improved 2008-09-15 17:05 intrenched 2008-09-15 17:05 hard to change 2008-09-15 17:06 also no interest from goog in making it easy to exclude the bot, it's all or nothing, or pain 2008-09-15 17:06 just look for +http:// in the user agent 2008-09-15 17:06 same with the others of course 2008-09-15 17:06 i mean cmon we use http + javascript for "pushing" data to a browser 2008-09-15 17:06 semi-polite bots all have that 2008-09-15 17:06 whcih is just a polling pull loop 2008-09-15 17:06 its all crap 2008-09-15 17:07 but xml makes it better ;) 2008-09-15 17:07 ACTION pukes a little in his mouth 2008-09-15 17:07 flips: .htpasswd? 2008-09-15 17:07 for the moment no robot's are hitting me 2008-09-15 17:07 pgquiles_, but the site needs to be public 2008-09-15 17:08 moonbase:/var/www# cat robots.txt 2008-09-15 17:08 User-agent: * 2008-09-15 17:08 Disallow: /ddtree 2008-09-15 17:08 ok? 2008-09-15 17:08 seems reasonable 2008-09-15 17:09 I think the bots are staying away until their next sniff cycle 2008-09-15 17:09 http://www.whitehouse.gov/robots.txt 2008-09-15 17:09 because of the / 2008-09-15 17:09 interesting 2008-09-15 17:09 from before 2008-09-15 17:09 thats the first result for robots.txt disallow on google 2008-09-15 17:10 that's the one site that should be completely indexed 2008-09-15 17:10 without option 2008-09-15 17:10 heh 2008-09-15 17:10 the only url it is pulling is /ddtree 2008-09-15 17:10 User-agent: whsearch 2008-09-15 17:10 everything else are just paremeters being passed to it 2008-09-15 17:11 so i think /ddtree is sufficient 2008-09-15 17:11 can search an extra dozen things 2008-09-15 17:11 ok 2008-09-15 17:11 later I will refine that 2008-09-15 17:11 so it allows searching the tux3 part of ddtree 2008-09-15 17:11 and only that 2008-09-15 17:27 it's time to do extents 2008-09-15 17:27 never mind I claimed I'd do versioning next on lkml 2008-09-15 17:27 extends = benchmarkability 2008-09-15 17:27 easy 2008-09-15 17:28 and that big zfs bully won't kick sand in the face of skinny little tux3 any more 2008-09-15 17:28 tux3 will learn ju-extent-fu 2008-09-15 17:29 well where do we start 2008-09-15 17:29 the hardest part is actually versioned extents, so it's convenient that's the part getting deferred 2008-09-15 17:29 -!- pgquiles__(~pgquiles@50.Red-79-153-248.staticIP.rima-tde.net) has joined #tux3 2008-09-15 17:30 we need to be able to alloc an extent for one thing 2008-09-15 17:30 so the bitmap scanning gets fancier 2008-09-15 17:30 not just searching for a bit any more, but a contiguous run of bits 2008-09-15 17:30 and sometimes it might be best for it to say: here's the longest run I found in that region 2008-09-15 17:31 instead of just failing because it didn't find the length asked 2008-09-15 17:31 gets into heuristics 2008-09-15 17:31 then what else 2008-09-15 17:32 extents only appear in dleaf 2008-09-15 17:32 so... 2008-09-15 17:32 caller of deaf methods has impact 2008-09-15 17:32 those are in btree.c and inode.c 2008-09-15 17:32 I wonder if there is any btree.c impact 2008-09-15 17:32 there should not be 2008-09-15 17:33 actually, btree.c never even knows its calling dleaf methods 2008-09-15 17:33 so I guess the entire impact is in inode.c 2008-09-15 17:33 maybe 2008-09-15 17:33 and balloc.c 2008-09-15 17:33 big and 2008-09-15 17:34 yeah, so that makes them easy right? :P 2008-09-15 17:34 relatively 2008-09-15 17:34 compard to versioned extents 2008-09-15 17:34 should just make them versioned to begin with 2008-09-15 17:34 but still one of the messier bits so far 2008-09-15 17:34 my head hurts just thinking about it 2008-09-15 17:34 defer 2008-09-15 17:34 haha 2008-09-15 17:34 gain experience 2008-09-15 17:34 with the simpler case 2008-09-15 17:34 that is like, at the core of tux3 though 2008-09-15 17:35 oh yeah 2008-09-15 17:35 heart and soul 2008-09-15 17:35 but winning benchmarks is too 2008-09-15 17:35 and I can smell blood ;) 2008-09-15 17:35 without versioning, boo 2008-09-15 17:35 :P 2008-09-15 17:35 doesn't bother me 2008-09-15 17:35 yeah 2008-09-15 17:35 walk first 2008-09-15 17:35 if versioning arrives a month later 2008-09-15 17:35 run later 2008-09-15 17:35 then jump 2008-09-15 17:35 then arabesque 2008-09-15 17:35 teleport 2008-09-15 17:36 right 2008-09-15 17:36 then stretch space and time so travel isn't necessary anymore 2008-09-15 17:36 that's called multicore 2008-09-15 17:36 heh 2008-09-15 17:36 or is it qubits? 2008-09-15 17:36 bubytes would rule 2008-09-15 17:36 drugs i think 2008-09-15 17:36 qubytes 2008-09-15 17:37 that too 2008-09-15 17:37 just imagine the great hack 2008-09-15 17:37 "in xanadu did kubla geek a stately filesystem arch decree" 2008-09-15 17:38 -- anon 2008-09-15 17:42 ok, I"m going to get another eee 2008-09-15 17:42 seems one isn't enough 2008-09-15 17:42 wow your original tux3 announcement is still in the hottest threads on lkml 2008-09-15 17:42 the wife likes it ;) 2008-09-15 17:42 so it is, pushed down a little by the time travel 2008-09-15 17:43 probably a plot by linus to get his spot back 2008-09-15 17:43 and who is frans pop, is that a real name? ;) <- jk 2008-09-15 17:44 wow, what next is in the top 2008-09-15 17:44 right after -rc6 and time travel 2008-09-15 17:46 getting close to sk8 oclock 2008-09-15 17:53 ACTION flips_rollin 2008-09-15 19:43 flips: http://milek.blogspot.com/2008/03/zfs-de-duplication.html 2008-09-15 19:46 -!- RazvanM(~RazvanM@pool-151-196-118-156.balt.east.verizon.net) has joined #tux3 2008-09-15 20:02 -!- tux3bot(~tux3bot@yzf.shapor.com) has joined #tux3 2008-09-15 20:03 -!- MaZe(~MaZe@216-239-45-4.google.com) has joined #tux3 2008-09-15 20:05 -!- Kirantpatil(~kiran@122.167.199.254) has joined #tux3 2008-09-15 20:05 -!- Kirantpatil(~kiran@122.167.199.254) has left #tux3 2008-09-15 20:06 -!- ChanServ changed mode/#tux3 -> -o hirofumi 2008-09-15 20:06 -!- ChanServ changed topic to "Tux3 list membership just hit 100! ~ http://tux3.org" 2008-09-15 21:04 -!- bh(~billh@ip68-107-26-122.sd.sd.cox.net) has joined #tux3 2008-09-15 21:04 back 2008-09-15 21:04 that was a bit wierd 2008-09-15 21:07 flips: what do you think about the link ? 2008-09-15 21:25 -!- Aks(~ankitsriv@59.90.32.1) has joined #tux3 2008-09-15 22:13 -!- Aks(~ankitsriv@59.90.32.1) has left #tux3 2008-09-15 23:49 flips: you there ?